Non-Scan Loss Verification at Self-Checkout Terminal

ABSTRACT

A system and method for verifying a non-scan item at a self-checkout point-of-sale terminal is provided. A merchandise item that isn&#39;t scanned at the self-checkout terminal is identified by a detection system. Further, a user helper device is provided to verify the incident by prompting the shopper for an input. The user helper device is operably connected to the self-checkout point-of-sale terminal and the detection system to determine and verify a fraudulent incident occurring during a transaction activity by the shoppers. Further, a store attendant device is provided for human intervention when necessary.

TECHNICAL FIELD

The present invention relates generally to a security system and methodto prevent fraudulent activities occurring at a self-checkout terminal.

BACKGROUND

When a shopper is detected with an un-scanned merchandise/item left inthe cart at the end of a self-checkout transaction, it may indicate anintent to steal the un-scanned item by leaving the checkout terminal andthe store with the un-scanned (thus unpaid) merchandise. However,another common case is that the shopper may intend to scan theun-scanned merchandise as part of a subsequent transaction, or theshopper simply forgets to scan the un-scanned item(s). Without beingable to determine which case it is, a conventional basket-based lossdetection system cannot give a verifiable indication to a self-checkoutattendant or loss prevention/security personnel to verify the shopper'sintent of stealing. In addition, there is currently no way to prompt orpoll the shopper to verify the transaction in question without anattendant spending time to walk over and address the alert.

Therefore, what is needed is a system and method for verifying afraudulent activity by receiving input from the shopper at theself-checkout terminal to reduce false-positive alerts and humanintervention.

SUMMARY

The subject matter of this application may involve, in some cases,interrelated products, alternative solutions to a particular problem,and/or a plurality of different uses of a single system or article.

According to one aspect, a system for verifying a non-scan item detectedat a self-checkout terminal is provided. The system may comprise a videosource, in communication with a processor, generating a video feedcapturing an area of interest at the self-checkout terminal. A non-scanitem detection module may be in communication with the processor,detecting the non-scan item based on at least a portion of the videofeed. A self-checkout terminal may be in communication with theprocessor, equipped with a scanner, detecting an item being transactedat the self-checkout terminal. Further, the system may comprise aself-checkout helper module, in communication with the processor and acomputerized user interface. The self-checkout helper module may issuean alert to the computerized user interface and receive a response tothe alert. The response may be inputted by a shopper via thecomputerized user interface. Lastly, the system may verify the alertbased on the response.

In another aspect, a method of verifying a non-scan item detect at aself-checkout terminal is provided. The method may be operated via acomputer processing unit. The method may begin with capturing a videofeed of an area of interest at the self-checkout terminal using a videosource. The method may continue with detecting the non-scan item basedon at least a portion of the video feed, using a non-scan item detectionmodule. Further, the method may comprise a step of issuing an alert to acomputerized user interface in communication with the self-checkouthelper device using the self-checkout helper device. Further yet, themethod may comprise a step of receiving a response, via the computerizeduser interface, to the alert. Finally, the method may verify the alertbased on the received response using the self-checkout helper device.

DESCRIPTION OF THE DRAWINGS

These and other advantages of the present invention may be readilyunderstood with the reference to the following specifications andattached drawings wherein:

FIG. 1 provides an exemplary embodiment of the system for verifying anon-scan item detected at a self-checkout terminal.

FIG. 2 provides another exemplary embodiment of the system for verifyinga non-scan item detect at a self-checkout terminal.

FIG. 3 provides an exemplary flowchart demonstrating the use of the SCOhelper device.

FIG. 4 provides an exemplary flowchart demonstrating the use of the SCOhelper device.

FIG. 5 provides an exemplary flowchart demonstrating the use of the SCOhelper device.

FIG. 6 provides an exemplary flowchart demonstrating the use of the SCOhelper device.

FIG. 7 provides an exemplary flowchart demonstrating the use of the SCOhelper device.

DETAILED DESCRIPTION

The detailed description set forth below in connection with the appendeddrawings is intended as a description of presently preferred embodimentsof the invention and does not represent the only forms in which thepresent invention may be constructed and/or utilized. The descriptionsets forth the functions and the sequence of steps for constructing andoperating the invention in connection with the illustrated embodiments.

In referring to the description, specific details are set forth in orderto provide a thorough understanding of the examples disclosed. In otherinstances, well-known methods, procedures, components and materials havenot been described in detail as not to unnecessarily lengthen thepresent disclosure.

Preferred embodiments of the present invention may be describedhereinbelow with reference to the accompanying drawings. In thefollowing description, well-known functions or constructions are notdescribed in detail because they may obscure the invention inunnecessary detail. No language in the specification should be construedas indicating any unclaimed element as essential to the practice of theembodiments. For this disclosure, the following terms and definitionsshall apply:

The terms “circuits” and “circuitry” refer to physical electroniccomponents (i.e. hardware) and any software and/or firmware (“code”)which may configure the hardware, be executed by the hardware, and orotherwise be associated with the hardware. As used herein, for example,a particular processor and memory may comprise a first “circuit” whenexecuting a first set of one or more lines of code and may comprise asecond “circuit” when executing a second set of one or more lines ofcode. As utilized herein, circuitry is “operable” to perform a functionwhenever the circuitry comprises the necessary hardware and code storedto a computer readable medium, such as a memory device (if any isnecessary) to perform the function, regardless of whether performance ofthe function is disabled or not enabled (e.g., by anoperator-configurable setting, factory trim, etc.).

It should be understood that if an element or part is referred herein asbeing “on”, “against”, “in communication with”, “connected to”,“attached to”, or “coupled to” another element or part, then it can bedirectly on, against, in communication with, connected, attached orcoupled to the other element or part, or intervening elements or partsmay be present.

As utilized herein, “and/or” means any one or more of the items in thelist joined by “and/or”. As an example, “x and/or y” means any elementof the three-element set {(x), (y), (x, y)}. In other words, “x and/ory” means “one or both of x and y”. As another example, “x, y, and/or z”means any element of the seven-element set {(x), (y), (z), (x, y), (x,z), (y, z), (x, y, z)}. In other words, “x, y and/or z” means “one ormore of x, y and z”.

As used herein, the terms “communicate” and “communicating” refer to (1)transmitting, or otherwise conveying, data from a source to adestination, and/or (2) delivering data to a communications medium,system, channel, network, device, wire, cable, fiber, circuit, and/orlink to be conveyed to a destination.

The term “database” as used herein means an organized body of relateddata, regardless of the manner in which the data or the organized bodythereof is represented. For example, the organized body of related datamay be in the form of one or more of a table, a map, a grid, a packet, adatagram, a frame, a file, an e-mail, a message, a document, a report, alist, or data presented in any other form. Database as used herein maybe in the format including, but are not limiting to, XML, JSON, CSV,binary, over any connection type: serial, Ethernet, etc. over anyprotocol: UDP, TCP, and the like.

The term “exemplary” means serving as a non-limiting example, instance,or illustration. Likewise, the terms “e.g.” and “for example” set offlists of one or more non-limiting examples, instances, or illustrations.

The term “network” as used herein includes both networks andinter-networks of all kinds, including the Internet, and is not limitedto any particular network or inter-network. Network contemplated hereinmay include, for example, one or more of the Internet, Wide AreaNetworks (WANs), Local Area Networks (LANs), analog or digital wired andwireless telephone networks (e.g., a PSTN, Integrated Services DigitalNetwork (ISDN), a cellular network, and Digital Subscriber Line (xDSL)),radio, television, cable, satellite, and/or any other delivery ortunneling mechanism for carrying data. Network may include multiplenetworks or sub-networks, each of which may include, for example, awired or wireless data pathway. The network may include acircuit-switched voice network, a packet-switched data network, or anyother network able to carry electronic communications. Examples include,but are not limited to, Picture Transfer Protocol (PTP) over InternetProtocol (IP), IP over Bluetooth, IP over WiFi, and PTP over IP networks(PTP/IP).

The term “processor” as used herein means processing devices,apparatuses, programs, circuits, components, systems, and subsystems,whether implemented in hardware, tangibly embodied software, or both,and whether or not it is programmable. The term “processor” as usedherein includes, but is not limited to, one or more computing devices,hardwired circuits, signal-modifying devices and systems, devices andmachines for controlling systems, central processing units, programmabledevices and systems, field-programmable gate arrays,application-specific integrated circuits, systems on a chip, systemscomprising discrete elements and/or circuits, state machines, virtualmachines, data processors, processing facilities, and combinations ofany of the foregoing.

As used herein, the words “about” and “approximately,” when used tomodify or describe a value (or range of values), mean reasonably closeto that value or range of values. Thus, the embodiments described hereinare not limited to only the recited values and ranges of values, butrather should include reasonably workable deviations.

As utilized herein, circuitry or a device is “operable” to perform afunction whenever the circuitry or device comprises the necessaryhardware and code (if any is necessary) to perform the function,regardless of whether performance of the function is disabled, or notenabled (e.g., by a user-configurable setting, factory trim, etc.).

The terminology used herein is for the purpose of describing particularembodiments only and is not intended to be limiting. As used herein, thesingular forms “a”, “an”, and “the”, are intended to include the pluralforms as well, unless the context clearly indicates otherwise. It shouldbe further understood that the terms “includes” and/or “including”, whenused in the present specification, specify the presence of statedfeatures, integers, steps, operations, elements, and/or components, butdo not preclude the presence or addition of one or more other features,integers, steps, operations, elements, components, and/or groups thereofnot explicitly stated.

Various operations may be described as multiple discrete operations inturn, in a manner that may be helpful in understanding embodiments;however, the order of description should not be construed to imply thatthese operations are order dependent.

Spatially relative terms, such as “under” “beneath”, “below”, “lower”,“above”, “upper”, “proximal”, “distal”, and the like, may be used hereinfor ease of description and/or illustration to describe one element orfeature's relationship to another element(s) or feature(s) asillustrated in the various figures. It should be understood, however,that the spatially relative terms are intended to encompass differentorientations of the device in use or operation in addition to theorientation depicted in the figures. For example, if the device in thefigures is turned over, elements described as “below” or “beneath” otherelements or features would then be oriented “above” the other elementsor features. Thus, a relative spatial term such as “below” can encompassboth an orientation of above and below. The device may be otherwiseoriented (rotated 90 degrees or at other orientations) and the spatiallyrelative descriptors used herein are to be interpreted accordingly.Similarly, the relative spatial terms “proximal” and “distal” may alsobe interchangeable, where applicable. Such descriptions are merely usedto facilitate the discussion and are not intended to restrict theapplication of disclosed embodiments.

The terms first, second, third, etc. may be used herein to describevarious elements, components, regions, parts and/or sections. It shouldbe understood that these elements, components, regions, parts and/orsections should not be limited by these terms. These terms have beenused only to distinguish one element, component, region, part, orsection from another region, part, or section. Thus, a first element,component, region, part, or section discussed below could be termed asecond element, component, region, part, or section without departingfrom the teachings herein.

Some embodiments of the present invention may be practiced on a computersystem that includes, in general, one or a plurality of processors forprocessing information and instructions, RAM, for storing informationand instructions, ROM, for storing static information and instructions,a memory device and instructions, modules as software units executing ona processor, an optional user output device such as a display screendevice (e.g., a monitor) for display screening information to thecomputer user, and an optional user input device.

As will be appreciated by those skilled in the art, the present examplesmay be embodied, at least in part, a computer program product embodiedin any tangible medium of expression having computer-usable program codestored therein. For example, some embodiments described below withreference to flowchart illustrations and/or block diagrams of methods,apparatus (systems) and computer program products can be implemented bycomputer program instructions. The computer program instructions may bestored in computer-readable media that can direct a computer, controlleror other programmable data processing apparatus to function in aparticular manner, such that the instructions stored in thecomputer-readable media constitute an article of manufacture includinginstructions and processes which implement the function/act/stepspecified in the flowchart and/or block diagram. These computer programinstructions may be provided to a processor of a general purposecomputer, special purpose computer, or other programmable dataprocessing apparatus to produce a machine, such that the instructions,which execute via the processor of the computer or other programmabledata processing apparatus, create means for implementing thefunctions/acts specified in the flowchart and/or block diagram block orblocks.

In the following description, reference is made to the accompanyingdrawings which are illustrations of embodiments in which the disclosedinvention may be practiced. It is to be understood, however, that thoseskilled in the art may develop other structural and functionalmodifications without departing from the novelty and scope of theinstant disclosure.

The system may comprise one or more computers or computerized elementsin communication working together to carry out the different functionsof the system. The invention contemplated herein further may comprise amemory device, such as a non-transitory computer readable mediaconfigured to instruct a computer or computers to carry out the stepsand functions of the system and method, as described herein. In someembodiments, the communication among the one or more computer or the oneor more processors alike, may support a plurality ofencryption/decryption methods and mechanisms of various types of data.

The computerized user interface may be comprised of one or morecomputing devices in networked communication with each other. Thecomputer or computers of the computerized user interface contemplatedherein may comprise a memory, processor, and input/output system. Insome embodiments, the computer may further comprise a networkedconnection and/or a display screen. These computerized elements may worktogether within a network to provide functionality to the computerizeduser interface. The computerized user interface may be any type ofcomputerized interfaces known in the art capable of allowing a user toinput data and receive a feedback therefrom. The computerized userinterface may further provide outputs executed by the systemcontemplated herein.

Computer or computing device contemplated herein may include, but arenot limited to, virtual systems, Cloud/remote systems, desktopcomputers, laptop computers, tablet computers, handheld computers, smartphones and other cellular phones, and similar internet enabled mobiledevices, digital cameras, a customized computing device configured tospecifically carry out the methods contemplated in this disclosure, andthe like.

Video source or video camera contemplated herein may include, but arenot limited to, a video camera such as, analog cameras and IP cameras,and the like; a device that can provide a video feed of any duration,such as a DVR; a portable computing device having a camera, such as atablet computer, laptop computer; and the like.

The term “data” as used herein means any indicia, signals, marks,symbols, domains, symbol sets, representations, and any other physicalform or forms representing information, whether permanent or temporary,whether visible, audible, acoustic, electric, magnetic, electromagnetic,or otherwise manifested. The term “data” is used to representpredetermined information in one physical form, encompassing any and allrepresentations of corresponding information in a different physicalform or forms. Data contemplated herein may be in the format including,but are not limiting to, XML, JSON, CSV, binary, over any connectiontype: serial, Ethernet, etc. over any protocol: UDP, TCP, and the like.

Scanner contemplated herein may process any type of machine-readablemedium, including but not limited to a barcode, a QR code,two-dimensional bar code, a prescribed font, optical characterrecognition (OCR) characters, Radio Frequency Identification (RFID),Near-Field Communication (NFC), Bluetooth technology, alphanumericcharacters, non-alphanumeric characters, symbols, facial recognition andthe like.

The system and device disclosed herein may be implemented as astandalone and dedicated device including hardware and installedsoftware, where the hardware is closely matched to the requirementsand/or functionality of the software. The system and device may beinstalled on or integrated with a network appliance (not shown)configured to establish the network among the components of the system.The system and the network appliance may be capable of operating as orproviding an interface to assist exchange of software instructions anddata among the components of the system.

The system and device disclosed herein may implement a server. Theserver may be implemented as any of a variety of computing devices,including, for example, a general purpose computing device, multiplenetworked servers (arranged in cluster or as a server farm), amainframe, or so forth.

In some embodiments, the network appliance may be preconfigured ordynamically configured to include the system integrated with otherdevices.

In a further embodiment, the device may be installed on or integratedwith one or more devices such as a computing device. For example, asmartphone or a tablet to perform the functionalities of the systemdisclosed herein.

In a further embodiment, the system and device disclosed herein may beintegrated with any number of devices in a distributed fashion.

The system disclosed herein may be implemented in hardware or a suitablecombination of hardware and software. In some embodiments, the systemmay be a hardware device including processor(s) executing machinereadable program instructions for analyzing data, and interactionsbetween the components of the system. The “hardware” may comprise acombination of discrete components, an integrated circuit, anapplication-specific integrated circuit, a field programmable gatearray, a digital signal processor, or other suitable hardware. The“software” may comprise one or more objects, agents, threads, lines ofcode, subroutines, separate software applications, two or more lines ofcode or other suitable software structures operating in one or moresoftware applications or on one or more processors. The processor(s) mayinclude, for example, microprocessors, microcomputers, microcontrollers,digital signal processors, central processing units, state machines,logic circuits, and/or any devices that manipulate signals based onoperational instructions. Among other capabilities, the processor(s) maybe configured to fetch and execute computer readable instructions in amemory associated with the system for performing tasks such as signalcoding, data processing input/output processing, power control, and/orother functions. The system may include modules as software unitsexecuting on a processor.

The system may include, in whole or in part, a software applicationworking alone or in conjunction with one or more hardware resources.Such software applications may be executed by the processor(s) ondifferent hardware platforms or emulated in a virtual environment.Aspects of the system, disclosed herein, may leverage known, relatedart, or later developed off-the-shelf software applications. Otherembodiments may comprise the system being integrated or in communicationwith a mobile switching center, network gateway system, Internet accessnode, application server, IMS core, service node, or some othercommunication systems, including any combination thereof. In someembodiments, the components of system may be integrated with orimplemented as a wearable device including, but not limited to, afashion accessory (e.g., a wrist band, a ring, etc.), a utility device(a hand-held baton, a pen, an umbrella, a watch, etc.), a body clothing,or any combination thereof.

The system may include a variety of known, related art, or laterdeveloped interface(s) (not shown), including software interfaces (e.g.,an application programming interface, a graphical user interface, etc.);hardware interfaces (e.g., cable connectors, a keyboard, a card reader,a barcode reader, a biometric scanner, an interactive display screen,etc.); or both.

The issued U.S. Pat. No. 7,631,808 describes in detail the process ofvideo analysis and transaction data analysis. As such, the issued U.S.Pat. No. 7,631,808 is incorporated herein by reference.

In its essence, U.S. Pat. No. 7,631,808 describes methods and apparatusfor detecting a transaction outcome such as a suspicious activityrelated to a transaction (e.g., purchase, refund, void, etc.) of itemsby a customer at a transaction terminal (i.e. self-checkout terminal).The system obtains video data associated with a transaction area. Thevideo data may be obtained, for example, from an elevated camera focusedon a cash register check out or other transaction area in a supermarketor other retail establishment. The system applies an automated machinevideo analysis algorithm that is disclosed as part of the system toanalyze at least a portion of the video data to obtain at least onevideo parameter concerning at least a portion of a transactionassociated with the transaction area. As an example, the system cananalyze the video data to track (e.g. identify the presence of) itemsinvolved in the transaction in the transaction area. This process canautomatically identify the presence of an item involved in thetransaction from the video data analysis. This can be done, for example,by automatically detecting item activity in the transaction area and/ordetecting operator activity in the transaction area. Detection of itempresence can include detecting removal of an item from a region ofinterest in the transaction area and/or detecting introduction of anitem into a region of interest in the transaction area.

Generally, the present invention concerns a system and method forverifying a non-scan item detected at a self-checkout terminal. Thesystem comprises a video source, such as a camera, recording a videofeed of the activities and/or events occurring at and around theself-checkout terminal (i.e. transaction activity, suspicious activity,fraudulent activity and the like). The system further comprises anon-scan item detection system to detect an item left un-scanned(hereinafter also referred to as “non-scan item”) at the self-checkoutterminal, shopping cart, basket, and the like. The system comprises acomputer processing unit which analyzes the video feed to identify thenon-scan item. Further, the system comprises a self-checkout helperdevice which acts as a communication channel between the shopper and theattendant, to verify whether the non-scan item detected by the non-scanitem detection system constitutes a fraudulent activity. Thus, thesystem and method for verifying a non-scan item disclosed hereinprovides a loss-prevention system and method that reduce false-positiverates in fraudulent activity detection and reduce a need for a humanintervention.

In one aspect, the present disclosure identifies a method for verifyinga fraudulent activity that may occur at a self-checkout terminal.Specifically, the present disclosure provides a method to verify anun-scanned item detected by a scan-avoidance/non-scan item detectionsystem by additionally verifying the un-scanned item with an inputreceived from a customer-user (i.e. shopper). The present disclosure mayvalidate one data feed that identifies an un-scanned item at aself-checkout area (such as a basket, cart, counter, scanning area, andthe like) based on an input received from the shopper. A computerprocessing unit may be operable to analyze a data feed generated bymonitoring an item being scanned at the self-checkout terminal.

In another aspect, the system disclosed herein comprises a self-checkouthelper device. The purpose of the self-checkout helper device(hereinafter also referred to as “SCO helper device”) is to interfacewith a non-scan item detection system to then proactively interact withthe shopper to verify, validate, prevent, deny, or confirm a potentialnon-scan item loss at the self-checkout terminal and to alert anattendant or customer service personnel accordingly.

In yet another aspect, the present disclosures improves detection andprevention of non-scan item loss by providing a basket-based non-scanloss verification system and method. Similarly, the system employing theself-checkout helper device can be utilized to prevent counter-basednon-scan Loss.

The term “basket” refers to a shopping bin for carrying items to bepurchase at a store. Baskets may include, but are not limiting to,shopping cart, shopping carriage, shopping basket, and the like.

The system and method for verifying a non-scan item at a self-checkoutterminal is presented. The present system may be utilized to verify afraudulent activity at the self-checkout terminal detected by a computerprocessing unit based on data feed obtained by various sensors. Thesystem and method for verifying a non-scan item at a self-checkoutterminal also may be utilized to prevent fraudulent activities, such astheft, from occurring at the self-checkout terminal.

Examples of fraudulent activities may include, but are not limited to,when a customer at the self-checkout terminal places an item that is notbeing transacted in a bagging area; places another item in place of theitem being purchased in a bagging area; places an item outside of thebagging area, such as on the floor, input area, or other areas notspecifically designated for collection of purchased item, withouttransacting it through the self-checkout terminal; and takes unpurchaseditems following the end of the transaction; and the like.

In one aspect, the system and method disclosed herein may integrate,implement, or utilizes a device which, upon detection of un-scanneditem(s) from a non-scan loss detection system, directly communicateswith the shopper during or after a transaction to serve the followingpurposes: (1) remind/prompt shopper to scan all of the items in casehe/she forgot; (2) allow an honest shopper to indicate information whichmay mitigate suspicion, for example, if an honest shopper is planning to“split” the transaction and pay for the un-scanned merchandise as partof a subsequent transaction; a detected un-scanned item is anon-merchandise item (such as a handbag or mobile phone); and (3)determine if a shopper may be trying to steal, and alert a storepersonnel, such as a self-checkout attendant, customer service or lossprevention/security personnel, and the like.

Additionally, the system and method disclosed herein may deter theshoppers from engaging in non-scan fraudulent activity in the future byalerting the shopper to the existence of a potentially suspiciousactivity during a transaction at the self-checkout terminal, such thatthe shopper may be able to self-correct.

The non-scan item detection system, described in U.S. Pat. No.8,146,811, employs a cart Inspector module to compare an image of ashopping cart with a predefined image of an empty shopping cartaccording to U.S. Pat. No. 8,146,811. The system and method describedtherein utilizes an image comparison and/or analysis to identify thenon-scan item left in a shopping cart. The method, carried out by acomputer processing unit, utilizes an image comparison function tocompare an instant image of the shopping cart and a model image of theshopping cart depicting an empty shopping cart. Thus, the non-scan itemdetection system may identify a difference between the images. Ifdifferent, the instant image may be an image of a suspicious transactionor a false positive condition.

There are many methods available for image comparison includinghistogram color analysis, geometric analysis, and edge comparisonanalysis. One embodiment employs the use of a multi-resolutioncorrelation technique. The images in the database are transformed into apyramid image using a wavelet transform. A correlation score is computedand a match is determined by comparing against a confidence threshold.Those items that have no matches are considered suspicious.

In some embodiments, a self-checkout helper device may be positioned ateach self-checkout terminals at a store. A non-scan item detectionsystem, such as the one described in U.S. Pat. No. 8,146,811,incorporate herein by reference, can be used to identify and/or detect anon-scan item left in the cart or at the input region (such as the inputshelf of the self-checkout terminal) or non-weight-checked output areas(such as the floor or bagging areas). Once the non-scan item detectionsystem detects a non-scan item, an alert may be sent to theself-checkout helper device. The self-checkout helper device may be incommunication with a computerized user interface, such as a display toalert the shopper about the non-scan item detection and to allow theshopper to address the issue.

The system and method for verifying a non-scan item detected at aself-checkout terminal may comprise a video source (i.e. CCTV camera)recording a video feed of an area of interest (i.e. shopping cart,basket, input area, bagging area, floor, etc.). Further, the system maycomprise a non-scan item detection system and a self-checkout helperdevice. The self-checkout terminal may be equipped with a scanner thatgenerates a transaction data as it scans an item being transacted at theself-checkout terminal.

FIG. 1 shows an exemplary embodiment of the system for verifying anon-scan item detected at a self-checkout terminal. The video source 106generates a video feed (i.e. video recording) of the self-checkoutterminal 102. The self-checkout terminal 102 may be equipped with ascanner 104 to scan the item's machine-readable code, such as a barcode,QR code and the like. While in this systematic diagram, the video sourcemonitors the self-checkout terminal, it may be positioned and/orconfigured to monitor a specific area of interest, such as the baggingarea or the transaction area. The bagging area refers to an area withinthe self-checkout terminal where a shopper places a transacted item intoa bag. The transaction area generally refers to an area within theself-checkout terminal where a transaction of an item occurs, such as ascanning area.

The non-scan item detection system 108 may be in communication with thevideo source 106 to obtain video and/or image of the area of interest atthe self-checkout terminal. The SCO helper device 110 may be positionedat the self-checkout terminal 102 to provide its function to the shopperat the location. The SCO helper device 110 may receive a notice from thenon-scan item detection system 108 when a non-scan item is detected bythe non-scan item detection system 108. A database 112 may be incommunication with the SCO helper device 110.

FIG. 2 shows another exemplary embodiment of the system for verifying anon-scan item detected at a self-checkout terminal. In this embodiment,functions of the SCO helper device 110 and the non-scan item detectionsystem 108 may be implemented by a server 202. The server may be incommunication with the self-checkout terminal 210 and the video source216. The SCO helper module 204 may issue an alert and/or communicatewith the user interface 212 installed at the self-checkout terminal 210.The self-checkout terminal 210 further employs the scanner 214 forgenerating transaction data. The function of the non-scan item detectionsystem as described herein may be operated by the non-scan itemdetection module 206 implemented by the server 202. The server 202 mayfurther include a database 208.

The system may use a CCTV footage as a video feed obtained from a camerasuch as, analog cameras, IP cameras, digital coax cameras and the like.The transactions data may be obtained from the self-checkout system orany other type of POS (point of sales) system. The system may alsocapture data feed from other sensors and retail store metadata notdepicted herein. The CCTV camera may capture a video feed data of theshopper interacting with the shopping cart, merchandise/non-merchandiseitems, and the self-checkout system itself. The non-scan item detectionsystem may correlate video feed data with the transaction data. Thesystem may analyze such data in real-time (or near real-time) andgenerate event(s) of items potentially not scanned during thetransaction. These events can then be sent to the self-checkout helperdevice. The SCO helper device may be mounted on the self-checkoutsystem, a standing podium, or any other place where the shopper canvisibly see the SCO helper device. The system may further comprise anattendant user device, for example a tablet. The attendant user devicemay be in communication with the SCO helper device to exchange (i.e.receive and send) communications from the SCO helper device. Theattendant user device may be a wearable device, such as, a smart watch,a portable tablet, a Self-Checkout RAP (Remote Assistant Program), aSelf-checkout portable RAP, and the like.

The self-checkout helper device may have a computerized user interfaceoperating therein. For example, the self-checkout helper device may be astandalone computing device. The self-checkout helper device may promptthe shopper (the customer-user) to verify the un-scanned item. Theself-checkout helper device may prompt the shopper via the computerizeduser interface subsequently after the non-scan item detection systemidentifies an item left un-scanned. Alternatively, the self-checkouthelper device may prompt the shopper after a predetermined time periodfrom the time of non-scan item detection system identifying theun-scanned item. This is to give the shopper a reasonable amount of timein between the scanning of multiple items at the self-checkout terminal.

As discussed herein, the SCO helper device may be directly integratedwith the SCO (self-checkout terminal). Similarly, the non-scan itemdetection system may be integrated with the SCO. In another aspect, thefunctions of the self-checkout helper device may be implemented by theself-checkout terminal. For example, the methods carried out by theself-checkout helper device may be implemented by another computingdevice, such as a self-checkout computer.

The system and method disclosed herein may be operated via a computerprocessing unit. The computer processing unit may be operable to analyzea data feed generated by monitoring an item being scanned at thecheckout terminal (i.e. scanner, video source, and the like). The datafeed may comprise a video feed and a transaction data. The data feed maybe obtained by the computer processing unit to identify and/or verify afraudulent activity. The video feed may be obtained from the videosource monitoring an item placed at a transaction area or other areas ofinterest at the self-checkout terminal.

In some embodiments, a video analysis may be utilized to verify thepossible fraudulent activity. A video feed may be generated by a videosource monitoring activities at a transaction area. The transaction areais not limited to a certain section of the self-checkout terminal, butmay include surrounding areas of the self-checkout terminal. The videoanalysis may be conducted via the computer processing unit where thevideo feed is analyzed frame by frame to identify the possiblefraudulent activity. The frame-by-frame analysis may identify an itemthat is not being sold at the store, in which case such activity may notbe the possible fraudulent activity. The video feed of the item beforeand after being placed at the bagging area may be analyzed to verify thepossible fraudulent activity. Various video analysis techniques areavailable and the method and process of the video analysis pertaining tothe present invention is being incorporated herein by reference.

A loss incident may be verified by the video analysis. The lossincidents contemplated herein may include, but are not limited to, whena customer neglects an item in a cart, a theft activity, and the like.The loss incident may occur when the item is not being placed at thebagging area and/or the transaction area. The lost incident may undergoa video analysis contemplated herein, using the non-scan item detectionmodule, to verify whether the loss incident truly occurred or not.

In some embodiments, the loss incident at a self-checkout terminal maybe verified by obtaining a video feed generated from the video sourcemonitoring an item at a transaction area. The video feed may be apartial video feed of the item during a transaction time. Thetransaction time indicates a period of time from the item beingintroduced to the self-checkout terminal to a payment being successfullytransacted. The video analysis of the video feed conducted by thecomputer processing unit may be verified by utilizing the self-checkouthelper device.

The transaction data may comprise variety of information of the item asit is scanned through the checkout terminal. For example, thetransaction data may comprise the identity of the item, the transactiontime (i.e. scan time), the price of the item, and the like. Whenmultiple items are scanned, the transaction data may also includetransaction count which refers to a number items scanned via the scannerequipped by the checkout terminal. As the transaction count isidentified using the scanner, the transaction count may be compared witha scan count of the items being placed at the bagging area.

The transaction data obtained by the checkout terminal may comprise avariety of information of the item as it is scanned through the checkoutunit's scanner. For example, the transaction data may comprise theidentity of the item, the transaction time (i.e. scan time), the priceof the item, and the like. A plurality of items and their correspondingprices and identities may be catalogued and stored in the database. Thetransaction time refers to a point in time (i.e. temporal position) inwhich the transaction of an item is detected (i.e. scan time). Whenmultiple items are scanned, the transaction data may also includetransaction count which refers to a number items scanned via the scannerequipped by the checkout terminal. As the transaction count isidentified using the scanner, the transaction count may be compared witha count of the items being placed at the bagging area.

In some embodiments, a transaction data may be correlated to the videoanalysis in order to verify the possible fraudulent activity. Using acombination of video analysis and/or image analysis in comparison withtransaction data, the system can determine if the presence of the itemidentified in the analysis of the video feed has a correspondingpresence in the transaction data, and if not, the system may identifysuch transacted item as a non-scanned item based on such discrepancyappearing, as a result of a correlative analysis between the transactiondata and the video/image analysis. As an example, the system can compareone or more data feed types to at least a portion of the transactiondata to identify at least one discrepancy in a number of itemstransacted at the checkout terminal. Transaction data such astransaction count (e.g. scan count), thus represents the presence of anitem or a number of items scanned by the scanner, while the item countfrom the video analysis represents the presence (or number) of itemsthat the customer causes to move through the transaction area monitoredby the video feed.

By way of example, the transaction count from the transaction data maybe compared to the item count identified from the video analysis. Whenthere is a discrepancy between the two counts (i.e. mismatch in countdata from two different data type), the system may identify thetransaction involving such discrepancy at the self-checkout terminal asa potentially fraudulent activity. In this example, the loss of an itemat the store may be prevented when the transaction count is smaller thanthe item count from the video analysis, which indicates that there is anun-scanned item present. Such incident can occur even when there is noitem left in the shopping cart. An item may pass through the transactionarea without being scanned by the scanner.

The self-checkout helper device may generate an alert prompting theshopper at the self-checkout terminal upon receiving a detection of anon-scan item from the non-scan item detection system. In someembodiments, the shopping cart may not contain any non-scanned item.Thus, the shopper is not prompted with any alert by the SCO helperdevice.

Referring now to FIG. 3, in another embodiment, the shopper maymistakenly leave an item in the shopping cart. As the non-scan item isdetected by the non-scan item detection device 300, the shopper may beprompted with an alert by the SCO helper device, thus the SCO helperdevice may generate the alert at 302. The alert may be in a form of aquestion. For example, the SCO helper device may prompt the shopper toverify whether the shopper is still conducting the transaction activity.The shopper may provide an input to the SCO helper device via the userinterface. Thus, the SCO helper device may receive input via the SCOhelper device 304. The input received by the SCO helper device may be intext form (such as typing), a selection the shopper makes (such astapping on touch screen), a speech (i.e. voice input) and other variousinput methods known.

As the shopper continues with the transaction leaving no non-scan itemin the transaction area, the alert may be removed 308, upon verifyingthe alert 306 once again, with the non-scan item detection system. Thus,the non-scan item detection device may conduct another sequence ofdetection cycle at the request of the SCO helper device as thetransaction events continuously occurs at the self-checkout terminal bythe shopper.

In some embodiments, the non-scan item detection device may generate afalse-positive alert. As the non-scan item detection device generates analert indicating the non-scan item 302 in the shopping cart, the SCOhelper device may prompt the shopper with the alert requiring averification of the alert by the shopper. As the SCO helper devicereceives the shopper's input 304 indicating that the alert isfalse-positive, the SCO helper device may retract the alert uponverifying the alert 306. Alternatively, the SCO helper device may sendan alert to the attendant user device 310, as shown in FIG. 4. Theattendant may be notified of the individual self-checkout terminal'salert level via the attendant user device. When the alert level ishigher, the SCO helper device may send an alert to the attendant userdevice requiring a human verification by the attendant.

In some embodiments, the SCO helper device, upon generating an alert302, may not receive any input from the shopper. For example, theshopper may simply ignore or be unaware of the alert being received bythe SCO helper device. In one aspect, the SCO helper device may requestthe self-checkout terminal to halt the transaction operation 316.Alternatively, the SCO helper device may send an alert to the attendantuser device 310. The SCO helper device may be preset with a set durationto receive any input from the point in time when the alert is generatedby the SCO helper device. Thus, the SCO helper device may start acountdown 314 upon generating the alert at 301. When no input isreceived by the SCO helper device 312 upon expiration of the countdown(i.e. the set duration of time), the SCO helper device may configure theoperation of the self-checkout terminal to be halted 316. By way ofexample, the SCO helper device may allow 10 seconds of wait time afterthe alert has been issued by the SCO helper device to the shopper at theself-checkout terminal.

In some embodiment, the shopper may ignore the alert being issued by theSCO helper device and leave the transaction area or the self-checkoutterminal. Upon detecting the shopper leaving the area, the SCO helperdevice may send an alert to the attendant user device for anintervention. The detection of the shopper leaving the transaction areamay be performed in various methods by various systems, including butnot limiting to, including video analytics systems and/or a motiondetection system which detect shopper presence or shopping cart trackingsystems, proximity detectors, etc.

The SCO helper device may be utilized to prevent any loss of un-scanneditems by simply issuing a notice via the SCO helper device to theshopper. The shopper may be mistakenly left an item in the shoppingcart. The SCO helper device may request the shopper to scan the itemleft in the shopping cart. Once the self-checkout terminal detects themissing item scanned, the SCO helper device may remove the notice andreturn to normal operation.

Now turning to FIG. 6, in some embodiments, the shopper may intend toconduct more than one transaction for a given set of items to bepurchased. In this embodiment, the non-scan item detection device maydetect the non-scan item remaining within the shopping cart 300.Consequently, the SCO helper device may prompt the shopper with an alert302 in a form of a question and receive an input from the shopper viathe SCO helper device 304. The SCO helper may prompt the shopper toverify whether there may be another transaction to occur at theself-checkout terminal. As there may be a case of the shopper falselyindicating that there may be another transaction, the alert may furtherrequire a secondary verification. In FIG. 6, the alert is verified bythe non-scan item detection system at 306 after receiving the input fromthe shopper via the SCO helper device 304. The SCO helper device maycontinue further with sending a request for a secondary validation 318to the attendant user device. In one aspect, the secondary verificationmay be requested to the attendant user device. In another aspect, thesecondary verification may be requested to the central computing devicefor another video/image comparison analysis.

In some embodiments, the shopper may attempt to leave the transactionarea with the non-scan item upon receiving an alert via the SCO helperdevice. The shopper may falsely indicate that there is no non-scan itemat the transaction area using the SCO helper device. In this embodiment,the SCO helper device may send an alert to the attendant prompting ahuman validation by the attendant.

The SCO helper device may prompt the shopper via the computerized userinterface with alert in the form of a question. The alert may takevarious forms, including a question. Such alert may be categorized intovarious level. For example, a yellow alert may be set as a medium levelalert which indicates a level of possibility where the fraudulentactivity may take place. Similarly, a red alert may be set as ahigh-level alert indicating a higher possibility of the fraudulentactivity taking place. The alert may be generated in different forms,which may include, but not limited to, visual message, text message,audible message, and the like.

The SCO helper device may present the alert in the form of a notice,such as a warning. The SCO helper device may prompt the shopper withseveral options from which the shopper can choose via the computerizeduser interface (e.g. the self-checkout helper device's display). Theseare customizable by the retailer. Thus, the self-checkout helper devicemay receive an input from the shopper via the SCO helper device, basedon which a possible fraudulent activity (such as an un-scanned items)may be verified. The type of questions and options (i.e. answers) areillustrated in examples shown below.

For example, some default options may include, “I'm still scanning” toindicate that the shopper is not done scanning all the items, “I haveanother transaction” to indicate that the shopper intends to scan theun-scanned items in another transaction, “I've scanned everything” toindicate that there are no un-scanned items or that the shopper has nointention of scanning any more items, and “I need help” to indicate thatthe self-checkout attendant should help this shopper finish thetransaction.

The alert provided to the shopper via the SCO helper device may employvarious types of communication. The alert may include a text, graphic,image, or video representation of the un-scanned item(s). This includesthe possibility of displaying an image or video clip recorded directlyfrom the current transaction of interest. The image or video may includethe shopper or crop or obfuscate the imagery to hide their identity. Themore specific the alert (e.g., showing the shopper circumventing thescan of a carton of eggs or giving up on a hard-to-scan gallon of milk)the better the ability for the shopper to understand and rectify thesituation by correctly scanning the un-scanned item of interest.

An alert also may be sent to the attendant user device when anattendant's validation of the detected non-scan item is needed. Thecomputerized user interface employed by the attendant user device mayprovide the attendant an alert issued by the one or more processors. Thealert being issued by the one or more processors may be in any formdiscussed herein. The computerized user interface of the attendant userdevice may provide the attendant an alert issued by the SCO helperdevice. The alert being issued may be in any form. The alert may be avisual alarm, such as light or other visual signals presented by thecomputerized user interface. The alert may be an audible alarm. Thealert may be an alert message presented on the computerized userinterface.

FIG. 7 illustrates an exemplary embodiment of the computerized userinterface provided by the SCO helper device to the shopper. The SCOhelper device 700 may provide a user interface area 704 where the alertmay be presented. The shopper may, using the SCO helper device, providean input to the alert via the user interface. In some embodiments, theSCO helper device may present a control panel 702 for the shopper tointeract with the user interface provided by the SCO helper device.

The SCO helper device may present a waiting screen via the computerizeduser interface. The waiting screen of the self-checkout helper devicecan be used for many purposes. In one aspect, it may be configured todisplay the retailer's logo. In another aspect, it can be used as anadvertisement space from vendors or retailers to advertise products,services, coupons, or any other information the retailer or theiraffiliates want to put in front of their shoppers.

The system and method disclosed herein may implement a face recognitionfunction utilizing the video source. The self-checkout helper device,when equipped with a front-facing camera, may take images of theshoppers using the front-facing camera and identifies the shopper at theself-checkout terminal. In one embodiment, the system may associateimages of shoppers, such as their faces, using standard face recognitiontechniques, with the ongoing transaction at the self-checkout terminal.This enables shopper tracking capabilities that links the shopper'sidentity as the shopper is identified using the face recognitionfunction. Such information can be used to track purchases, issuerewards, personalize coupons and other incentives, personalizeadvertisement displayed on the Self-checkout helper device or otherdevices, as well as for loss prevention purposes.

When any fraudulent activity (i.e. un-scanned item) is identified by thenon-scan item detection system, the face recognition system may identifythe shopper and the identity may be tagged with such incident. In someaspect, the shopper's identity can be put on a watch list. Uponidentifying that shopper again via the face recognition system, theshopper's identity can be compared to the watch list, and an alert canbe generated to alert the attendant of the presence of the shopper inquestion. The alert may be generated to the SCO helper device and/or theattendant user device. In some aspect, the facial recognition system maybe available at an exit of the store to issue an alarm when the shopperattempts to leave the store with the non-scan item unresolved and/orunverified.

By way of example, the self-checkout helper device can also operate asan alert mechanism when positioned at the exit to a store. It can act asa simulated EAS-style pedestal alarm, alerting when a shopper ofinterest passes by. The front-facing camera can be used to track theidentity of the shopper as well. The shopper would first be identifiedat the self-checkout using the self-checkout helper device situatedthere. An alert or exception activity would then be detected inconjunction with that shopper's transaction. This alert may even beidentified after the transaction is completed and the shopper is movingaway from the self-checkout register. The face identity is thencommunicated from the backend server to the EAS-style self-checkouthelper device located at the store exit. Once that camera and theassociated face recognition piece identifies the shopper walking towardthe exit, the EAS-style self-checkout helper device then alerts to thepresence of the shopper, and a description of the alert is presented onthe device. The alert can consist of any of the following: a standardmessage, a description of the alert, a picture indicative of the alert,a video indicative of the alert, an audible tone, sound, voice, or otheraudible alert.

The self-checkout helper device can also be used as a communicationmedium between the attendant and the shopper. The SCO helper device andthe attendant user device may be in communication with one another eachequipped with user interfaces. The attendant user device may displayvideo of the transaction received from the SCO helper device. TheSelf-checkout helper device may even display a picture of the remoteoperator to more personalize the experience. The picture can either be areal image of the person, a real video of the person operating inreal-time, or it can be a stylized picture or video, such as an onlineavatar, either a still image or video. The attendant may be remotelyenable such communication capabilities using one or more networkedservers.

EXEMPLARY SCENARIOS

The following examples embodies the system and method disclosed herein.While particular scenarios are described, the examples are presented toshowcase the applications of the SCO helper device, thus they are notintended to be limiting.

Example 1—No Non-Scanned Items

-   -   1. Shopper completes scanning items with no items left in        shopping cart    -   2. Basket Based Non-scan item detection System determines        nothing is left in the shopping cart    -   3. Shopper completes transaction        “Shopper completes scanning items” means that the Shopper has        finished scanning all of the items that they plan on scanning as        part of the current transaction (even if there are merchandise        items left un-scanned). The Shopper typically indicates to SCO        the completion of Shopper's scanning of items by either clicking        “transaction completed” or just starting the tender/payment        process.)

Example 2—Shopper Forgets about Items in Basket

-   -   1. Shopper completes scanning items with merchandise item(s)        left in shopping cart    -   2. Basket Based Non-scan item detection System identifies items        in shopping cart    -   3. Shopper is prompted with choices via the SCO helper device:        -   a. “I'm still scanning”        -   b. “I Have Another Transaction”        -   c. “I've Scanned Everything”        -   d. “I need help”    -   4. Attendant is warned that the shopper may need help. This may        be a medium-level or “yellow” alert (as opposed to a high level        “red” alert). This is an optional step and may not be in all        embodiments of the system.    -   5. Shopper selects the (a) “I'm still scanning” to indicate the        shopper intends to scan rest of items in the cart on the current        transaction    -   6. If a prior warning had been sent, then it is cleared for        attendant when scanning resumes.

Example 3—Shopper Wants to Put Remaining Items on Another Transaction

-   -   1. Shopper completes scanning items with merchandise item(s)        left in shopping cart    -   2. Basket Based Non-scan item detection System identifies        merchandise item(s) in the shopping cart    -   3. Shopper is prompted with choices via the SCO helper device:        -   a. “I'm still scanning”        -   b. “I Have Another Transaction”        -   c. “I've Scanned Everything”        -   d. “I need help”    -   4. Attendant is warned that the shopper may need help. This may        be a medium-level or “yellow” alert (as opposed to a high level        “red” alert). This is an optional step and may not be in all        embodiments of the system.    -   5. Shopper selects the (b) “I Have Another Transaction” to        indicate the shopper will start a new transaction for the rest        of the items    -   6. Shopper starts new transaction    -   7. If a prior warning had been sent, then it is cleared for        attendant when new transaction is started

Example 4—Basket Based Non-Scan Item Detection System Generates a FalseAlarm

-   -   1. Shopper completes scanning items with no merchandise items        left in shopping cart    -   2. Basket Based Non-scan item detection System incorrectly        identifies merchandise item(s) in shopping cart    -   3. Shopper is prompted with choices via the SCO helper device:        -   a. “I'm still scanning”        -   b. “I Have Another Transaction”        -   c. “I've Scanned Everything”        -   d. “I need help”    -   4. Attendant is warned that customer may need help. This may be        a medium-level or “yellow” alert (as opposed to a high level        “red” alert). This is an optional step and may not be in all        embodiments of the system.    -   5. Shopper selects the (c) “I've Scanned Everything” to indicate        that there is nothing left to scan    -   6. Attendant is alerted to potentially suspicious activity    -   7. Attendant confirms that the shopper has no items left to scan        and clears alert    -   8. Shopper leaves having completed transaction

Example 5—Shopper is Confused/Flustered

-   -   1. Shopper completes scanning items with merchandise item(s)        left in shopping cart    -   2. Basket Based Non-scan item detection System identifies        merchandise item(s) in shopping cart    -   3. Shopper is prompted with choices via the SCO helper device:        -   a. “I'm still scanning”        -   b. “I Have Another Transaction”        -   c. “I've Scanned Everything”        -   d. “I need help”    -   4. Attendant is warned that customer may need help. This may be        a medium-level or “yellow” alert (as opposed to a high level        “red” alert). This is an optional step and may not be in all        embodiments of the system.    -   5. Shopper selects the (d) “I need help” to indicate the        customer is unsure on what to do next    -   6. Attendant is alerted that a customer needs assistance    -   7. Attendant walks over to Self-checkout device    -   8. Attendant assists shopper in scanning rest of the items and        completes transaction

Example 6—Shopper Attempts to Leave with Non-Scanned Items

-   -   1. Shopper completes scanning items with merchandise item(s)        left in shopping cart    -   2. Basket Based non-scan item detection System determines items        in shopping cart    -   3. Shopper is prompted with choices via the SCO helper device:        -   a. “I'm still scanning”        -   b. “I Have Another Transaction”        -   c. “I've Scanned Everything”        -   d. “I need help”    -   4. Attendant is warned that customer may need help. This may be        a medium-level or “yellow” alert (as opposed to a high level        “red” alert). This is an optional step and may not be in all        embodiments of the system.    -   5. Shopper selects the (c) “I've Scanned Everything” to indicate        that there is nothing left to scan    -   6. Attendant is alerted to potentially suspicious activity    -   7. Attendant sees that there are items still left to be scanned    -   8. Attendant walks over to Self-checkout device    -   9. Attendant assists shopper in scanning rest of the items and        completes Transaction

Example 7—Shopper Attempts to Leave with Non-Scanned Items and withoutInteracting with System

-   -   1. Shopper completes scanning items with merchandise item(s)        left in shopping cart    -   2. Basket Based non-scan item detection System determines items        in shopping cart    -   3. Shopper is prompted with choices via the SCO helper device:        -   a. “I'm still scanning”        -   b. “I Have Another Transaction”        -   c. “I've Scanned Everything”        -   d. “I need help”    -   4. Attendant is warned that customer may need help. This may be        a medium-level or “yellow” alert (as opposed to a high level        “red” alert). This is an optional step and may not be in all        embodiments of the system.    -   5. Shopper begins leaving without selecting any choice    -   6. Non-scan item detection system determines that shopper is        leaving.*    -   7. Attendant is alerted to potentially suspicious activity    -   8. Attendant walks over to Shopper and sees that there are items        still left to be scanned    -   9. Attendant walks over to Self-checkout device with Shopper    -   10. Attendant assists shopper in scanning rest of the items and        completes transaction

Example 8—No Non-Scanned Items

-   -   1. Shopper completes scanning items with no items left in        shopping cart    -   2. Basket Based Non-scan item detection System determines        nothing is left in the shopping cart    -   3. Shopper completes transaction

Example 9—Shopper Forgets about Items in Basket

-   -   1. Shopper completes scanning items with merchandise item(s)        left in shopping cart    -   2. Basket Based Non-scan item detection System identifies items        in shopping cart    -   3. SCO stops transaction processing and the Self-checkout helper        Device prompts the shopper with choices:        -   a. “I'm still scanning”        -   b. “I Have Another Transaction”        -   c. “I've Scanned Everything”        -   d. “I need help”    -   4. Attendant is warned that the shopper may need help. This may        be a medium-level or “yellow” alert (as opposed to a high level        “red” alert). This is an optional step and may not be in all        embodiments of the system.    -   5. Shopper selects the (a) “I'm still scanning” to indicate the        shopper intends to scan rest of items in the cart    -   7. SCO returns to itemization mode and if a prior warning had        been sent, then it is cleared for attendant.

Example 10—Shopper Wants to Put Remaining Items on Another Transaction

-   -   1. Shopper completes scanning items with merchandise item(s)        left in shopping cart    -   2. Basket Based Non-scan item detection System identifies items        in shopping cart    -   3. SCO stops transaction processing and the Self-checkout helper        Device presents user with the choices:        -   a. “I'm still scanning”        -   b. “I Have Another Transaction”        -   c. “I've Scanned Everything”        -   d. “I need help”    -   4. Attendant is warned that the shopper may need help. This may        be a medium-level or “yellow” alert (as opposed to a high level        “red” alert). This is an optional step and may not be in all        embodiments of the system.    -   5. Shopper selects the (b) “I Have Another Transaction” to        indicate the shopper will start a new transaction for the rest        of the items    -   6. SCO returns to previous mode and warning is cleared for        attendant    -   7. Shopper completes transaction    -   8. SCO automatically prompts shopper to begin new transaction    -   9. Attendant can be alerted if shopper does not start new        transaction after a predetermined period of time

Example 11—Basket Based Non-Scan Item Detection System Generates a FalseAlarm

-   -   1. Shopper completes scanning items with no merchandise items        left in shopping cart    -   2. Basket Based Non-scan item detection System incorrectly        identifies merchandise item(s) in shopping cart    -   3. SCO stops transaction processing and the Self-checkout helper        Device prompts the shopper with choices:        -   a. “I'm still scanning”        -   b. “I Have Another Transaction”        -   c. “I've Scanned Everything”        -   d. “I need help”    -   4. Attendant is warned that customer may need help on RAP/mobile        RAP device. This may be a medium-level or “yellow” alert (as        opposed to a high level “red” alert). This is an optional step        and may not be in all embodiments of the system.    -   5. Shopper selects the (c) “I've Scanned Everything” to indicate        that there is nothing left to scan    -   6. Attendant is alerted to potentially suspicious activity on        RAP/mobile RAP device    -   7. Attendant confirms that the shopper has no items to scan and        clears alert    -   8. Shopper completes transaction

Example 12—Shopper is Confused/Flustered

-   -   1. Shopper completes scanning items with merchandise item(s)        left in shopping cart    -   2. Basket Based Non-scan item detection System identifies        merchandise item(s) in shopping cart    -   3. SCO stops transaction processing and the Self-checkout helper        Device prompts the shopper with choices:        -   a. “I'm still scanning”        -   b. “I Have Another Transaction”        -   c. “I've Scanned Everything”        -   d. “I need help”    -   4. Attendant is warned that customer may need help on RAP/mobile        RAP device. This may be a medium-level or “yellow” alert (as        opposed to a high level “red” alert). This is an optional step        and may not be in all embodiments of the system.    -   5. Shopper selects the (d) “I need help” to indicate the        customer is unsure on what to do next    -   6. Attendant is alerted that a customer needs assistance on        RAP/mobile RAP device    -   7. Attendant walks over to Self-checkout device    -   8. Attendant assists shopper in scanning rest of the items and        completes transaction

Example 13—Shopper Attempts to Leave with Non-Scanned Items

-   -   1. Shopper completes scanning items with merchandise item(s)        left in shopping cart    -   2. Basket Based non-scan item detection System determines items        in shopping cart    -   3. SCO stops transaction processing and the Self-checkout helper        Device prompts the shopper with choices:        -   a. “I'm still scanning”        -   b. “I Have Another Transaction”        -   c. “I've Scanned Everything”        -   d. “I need help”    -   4. Attendant is warned that customer may need help on RAP/Mobile        RAP. This may be a medium-level or “yellow” alert (as opposed to        a high level “red” alert). This is an optional step and may not        be in all embodiments of the system.    -   5. Shopper selects the (c) “I've Scanned Everything” to indicate        that there is nothing left to scan    -   6. Attendant is alerted to potentially suspicious activity on        RAP/Mobile RAP    -   7. Attendant sees that there are items still left to be scanned    -   8. Attendant walks over to Self-checkout device    -   9. Attendant assists shopper in scanning rest of the items and        completes transaction

Example 14—NO Non-Scanned Items

-   -   1. Shopper completes scanning items with no items left in        shopping cart    -   2. Basket Based Non-scan item detection System determines        nothing is left in the shopping cart    -   3. Shopper completes transaction

Example 15—Shopper Forgets about Items in Basket

-   -   1. Shopper completes scanning items with merchandise item(s)        left in shopping cart    -   2. Basket Based Non-scan item detection System identifies items        in shopping cart    -   3. SCO stops transaction processing and prompts the shopper with        choices:        -   a. “I'm still scanning”        -   b. “I Have Another Transaction”        -   c. “I've Scanned Everything”        -   d. “I need help”    -   4. Attendant is warned that the shopper may need help on        RAP/mobile RAP device. This may be a medium-level or “yellow”        alert (as opposed to a high level “red” alert). This is an        optional step and may not be in all embodiments of the system.    -   5. Shopper selects the (a) “I'm still scanning” to indicate the        shopper intends to scan rest of items in the cart    -   6. SCO returns to itemization mode and alert is cleared for        attendant on the RAP/Mobile RAP device

Example 16—Shopper Wants to Put Remaining Items on Another Transaction

-   -   1. Shopper completes scanning items with merchandise item(s)        left in shopping cart    -   2. Basket Based Non-scan item detection System identifies items        in shopping cart    -   3. SCO stops transaction processing and prompts the shopper with        choices:        -   a. “I'm still scanning”        -   b. “I Have Another Transaction”        -   c. “I've Scanned Everything”        -   d. “I need help”    -   4. Attendant is warned that the shopper may need help on        RAP/mobile RAP device. This may be a medium-level or “yellow”        alert (as opposed to a high level “red” alert). This is an        optional step and may not be in all embodiments of the system.    -   5. Shopper selects the (b) “I Have Another Transaction” to        indicate the shopper will start a new transaction for the rest        of the items    -   6. SCO returns to previous mode and warning is cleared for        attendant on RAP/mobile RAP device    -   7. Shopper completes transaction    -   8. SCO automatically prompts shopper to begin new transaction    -   9. Attendant can be alerted if shopper does not start new        transaction after a predetermined period of time

Example 17—Basket Based Non-Scan Item Detection System Generates a FalseAlarm

-   -   1. Shopper completes scanning items with no merchandise items        left in shopping cart    -   2. Basket Based Non-scan item detection System incorrectly        identifies merchandise item(s) in shopping cart    -   3. SCO stops transaction processing and prompts the shopper with        choices:        -   a. “I'm still scanning”        -   b. “I Have Another Transaction”        -   c. “I've Scanned Everything”        -   d. “I need help”    -   4. Attendant is warned that customer may need help on RAP/mobile        RAP device. This may be a medium-level or “yellow” alert (as        opposed to a high level “red” alert). This is an optional step        and may not be in all embodiments of the system.    -   5. Shopper selects the (c) “I've Scanned Everything” to indicate        that there is nothing left to scan    -   6. Attendant is alerted to potentially suspicious activity on        RAP/mobile RAP device    -   7. Attendant confirms that the shopper has no items to scan and        clears alert    -   8. Shopper completes transaction

Example 18—Shopper is Confused/Flustered

-   -   1. Shopper completes scanning items with merchandise item(s)        left in shopping cart    -   2. Basket Based Non-scan item detection System identifies        merchandise item(s) in shopping cart    -   3. SCO stops transaction processing and prompts the shopper with        choices:        -   a. “I'm still scanning”        -   b. “I Have Another Transaction”        -   c. “I've Scanned Everything”        -   d. “I need help”    -   4. Attendant is warned that customer may need help on RAP/mobile        RAP device. This may be a medium-level or “yellow” alert (as        opposed to a high level “red” alert). This is an optional step        and may not be in all embodiments of the system.    -   5. Shopper selects the (d) “I need help” to indicate the        customer is unsure on what to do next    -   6. Attendant is alerted that a customer needs assistance on        RAP/mobile RAP device    -   7. Attendant walks over to Self-checkout device    -   8. Attendant assists shopper in scanning rest of the items and        completes transaction

Example 19—Shopper Attempts to Leave with Non-Scanned Items

-   -   1. Shopper completes scanning items with merchandise item(s)        left in shopping cart    -   2. Basket Based non-scan item detection System determines items        in shopping cart    -   3. SCO stops transaction processing and prompts the shopper with        choices:        -   a. “I'm still scanning”        -   b. “I Have Another Transaction”        -   c. “I've Scanned Everything”        -   d. “I need help”    -   4. Attendant is warned that customer may need help on RAP/Mobile        RAP. This may be a medium-level or “yellow” alert (as opposed to        a high level “red” alert). This is an optional step and may not        be in all embodiments of the system.    -   5. Shopper selects the (c) “I've Scanned Everything” to indicate        that there is nothing left to scan    -   6. Attendant is alerted to potentially suspicious activity on        RAP/Mobile RAP    -   7. Attendant sees that there are items still left to be scanned    -   8. Attendant walks over to Self-checkout device    -   9. Attendant assists shopper in scanning rest of the items and        completes transaction

Example 20—No Non-Scanned Items

-   -   1. Shopper completes scanning items with no missed items during        the transaction    -   2. Non-scan item detection System determines nothing is left in        the shopping cart    -   3. Shopper completes transaction

Example 21—Shopper Misses Item(s) During the Transactions by Mistake

-   -   1. During scanning the shopper misses 1+ merchandise item(s)        with without the corresponding scan(s)    -   2. Non-scan item detection System identifies event    -   3. SCO Helper Device prompts the shopper with choices:        -   a. “I will reattempt to scan the item(s)”        -   b. “It was an accidental non-merchandise item”        -   c. “Everything scanned correctly”        -   d. “I need help”    -   4. Attendant is warned that the shopper may need help. This may        be a medium-level or “yellow” alert (as opposed to a high level        “red” alert). This is an optional step and may not be in all        embodiments of the system.    -   5. Shopper selects the (a) “I will reattempt to scan the        item(s)” to indicate the shopper intends reattempt to scan item.    -   6. Shopper scans items previously missed    -   7. If a prior warning had been sent, then it is cleared for        attendant.    -   8. Shopper completes transaction

Example 22—Shopper Passes a Non-Merchandise Item During the Transaction

-   -   1. During scanning the shopper passes 1+ non-merchandise item(s)        such as a hand bag or umbrella from an input region to an output        region    -   2. Non-scan item detection System identifies event    -   3. SCO Helper Device prompts the shopper with choices:        -   a. “I will reattempt to scan the item(s)”        -   b. “It was an accidental non-merchandise item(s)”        -   c. “Everything scanned correctly”        -   d. “I need help”    -   4. Attendant is warned that the shopper may need help. This may        be a medium-level or “yellow” alert (as opposed to a high level        “red” alert). This is an optional step and may not be in all        embodiments of the system.    -   5. Shopper selects the (b) “It was an accidental non-merchandise        item(s)” to indicate to the system the item is not an item that        is sold in the establishment.    -   8. Shopper continues to scan items and if a prior warning had        been sent, then it is cleared for attendant.

Example 23—Shopper Attempts to Pass Merchandise Item(s) without Scanningit During the Transaction

-   -   1. During scanning the shopper passes 1+ merchandise item(s)        from an input region to an output region    -   2. Non-scan item detection System identifies event    -   3. SCO Helper Device prompts the shopper with choices:        -   a. “I will reattempt to scan the item(s)”        -   b. “It was an accidental non-merchandise item(s)”        -   c. “Everything scanned correctly”        -   d. “I need help”    -   4. Attendant is warned that the shopper may need help. This may        be a medium-level or “yellow” alert (as opposed to a high level        “red” alert). This is an optional step and may not be in all        embodiments of the system.    -   5. Shopper selects the (c) “Everything scanned correctly”.    -   6. Shopper continues to scan items    -   7. The attendant is notified.    -   8. Attendant reviews notification and determines that there are        at least one item that has not been scanned    -   9. Attendant approaches shopper(s) aids the shopper(s) in        scanning the item(s) that have been missed.    -   10. Shopper completes transaction

Example 24—Non-Scan Item Detection Systems Generates a False Positive

-   -   1. Shopper scans items without an additional item    -   2. Non-scan item detection System identifies incorrect non-scan        event    -   3. SCO Helper Device prompts the shopper with choices:        -   a. “I will reattempt to scan the item(s)”        -   b. “It was an accidental non-merchandise item(s)”        -   c. “Everything scanned correctly”        -   d. “I need help”    -   4. Attendant is warned that the shopper may need help. This may        be a medium-level or “yellow” alert (as opposed to a high level        “red” alert). This is an optional step and may not be in all        embodiments of the system.    -   5. Shopper selects the (c) “Everything scanned correctly” to        indicate to the system has made a mistake.    -   6. Shopper continues to scan items    -   7. The attendant is notified.    -   8. Attendant reviews notification and determines that there are        no items that has not been scanned    -   9. Attendant clears alert    -   10. Shopper completes transaction

Example 25—Shopper is Confused/Flustered During the Transaction

-   -   1. During scanning the shopper passes 1+ item(s) from an input        region to an output region without the corresponding scan(s)    -   2. Non-scan item detection System identifies event    -   3. SCO Helper Device prompts the shopper with choices:        -   a. “I will reattempt to scan the item(s)”        -   b. “It was an accidental non-merchandise item(s)”        -   c. “Everything scanned correctly”        -   d. “I need help”    -   4. Attendant is warned that the shopper may need help. This may        be a medium-level or “yellow” alert (as opposed to a high level        “red” alert). This is an optional step and may not be in all        embodiments of the system.    -   5. Shopper selects the (d) “I need help” to indicate to the        system that the shopper is unclear what happened and/or what the        shopper needs to do next.    -   6. Attendant is notified    -   7. Attendant assists shopper in scanning item(s) that have        previously not scanned    -   8. Attendant assists shopper with the rest of the transaction if        necessary    -   9. Shopper completes transaction

In addition to the examples above, similar functions can be deployed fora system environment where the SCO helper device is Integrated with SCOand/or implemented by SCO as described in previous sections.Furthermore, in another embodiment for Counter-based Non-Scan LossPrevention, the Self-checkout helper device can prompt and poll theshopper at the end of the transaction (rather than during thetransaction as described in the scenarios in this section) much in thesame way as described in the Basket-Based Non-Scan Loss Preventionsection.

The embodiments and examples provided herein primarily illustrates thefunctions of the present invention in an environment involving aself-checkout terminal. It is to be understood that the functions,process, and/or methods described herein may also be implemented inother variety of POS (Point of Sales) system, including a traditionalcashier checkout terminal.

While several variations of the present invention have been illustratedby way of example in preferred or particular embodiments, it is apparentthat further embodiments could be developed within the spirit and scopeof the present invention, or the inventive concept thereof. However, itis to be expressly understood that such modifications and adaptationsare within the spirit and scope of the present invention, and areinclusive, but not limited to the present disclosure. Thus, it is to beunderstood that the invention may therefore by practiced otherwise thanas specifically described above. Many other modifications, variations,applications, and alterations of the present disclosure will beascertainable to those having ordinary skill in the art.

What is claimed is:
 1. A system for verifying a non-scan item detectedat a self-checkout terminal, comprising: a video source, incommunication with a processor, operable to generate a video feedcapturing an area of interest at the self-checkout terminal; a non-scanitem detection module, in communication with the processor, detectingthe non-scan item based on at least a portion of the video feed; aself-checkout terminal, in communication with the processor, equippedwith a scanner, wherein the scanner detects an item being transacted atthe self-checkout terminal; and a self-checkout helper module, incommunication with the processor and a computerized user interface,configured to: issue an alert to the computerized user interface;receive a response to the alert, the response being inputted by ashopper via the computerized user interface; and verify the alert basedon the response.
 2. The system of claim 1 wherein the non-scan itemdetection module detects the non-scan item based on a transaction dataobtained by the self-checkout terminal and the video feed.
 3. The systemof claim 1 wherein the non-scan item detection module detects thenon-scan item by comparing a frame of the video feed to a model image.4. The system of claim 1 wherein the alert is in the form of at leastone of a question, a message, and a notice, wherein the alert requeststhe response to be inputted by the shopper.
 5. The system of claim 1further comprising an attendant user device in communication with theself-checkout helper module, wherein the self-checkout helper module isfurther configured to issue the alert to the attendant user device. 6.The system of claim 5 wherein the attendant user device receives inputfrom the attendant to assist the shopper with the alert.
 7. The systemof claim 1 further comprising a face recognition module, incommunication with the processor, identifying an identity of the shopperbased on facial features of the shopper obtained by the video source. 8.The system of claim 7 further comprising an alarm device, incommunication with the self-checkout helper module, wherein the alarmdevice issues an alarm when the identified identity of the shopper islinked to a fraudulent activity.
 9. The system of claim 1 furthercomprising a motion detector equipped by the self-checkout terminal todetect a presence of the shopper entering in or exiting out theself-checkout terminal.
 10. The system of claim 1 further comprising analarm device, in communication with the self-checkout helper module,located at an exit of a store employing the self-checkout terminal,wherein the alarm device issues an alarm when the non-scan item isdetected near the exit.
 11. The system of claim 1 wherein the alert isat least one of visual message, text message, and audible message. 12.The system of claim 1 wherein the area of interest is a shopping cart.13. A method of verifying a non-scan item detect at a self-checkoutterminal, the method operated via a computer processing unit, comprisingthe steps of: capturing a video feed, with a video source, of an area ofinterest at the self-checkout terminal; detecting the non-scan item,with a non-scan item detection module, based on at least a portion ofthe video feed; issuing an alert, with a self-checkout helper device, toa computerized user interface in communication with the self-checkouthelper device; receiving a response, via the computerized userinterface, to the alert; and verifying the alert, with the self-checkouthelper device, based on the received response.
 14. The method of claim13 wherein the step of detecting the non-scan item comprises detectingthe non-scan item based on a transaction data obtained by theself-checkout terminal and the video feed.
 15. The method of claim 13wherein the step of detecting the non-scan item comprises comparing aframe of the video feed to a model image.
 16. The method of claim 13wherein the alert is in the form of at least one of a question, amessage, and a notice, wherein the alert requests the response to beinputted by the shopper.
 17. The method of claim 13 further comprisingthe step of issuing the alert and the response to an attendant userdevice, with the self-checkout helper device.
 18. The method of claim 13further comprising the step of identifying an identity of the shopper,with a face recognition module, based on facial features of the shopperobtained by the video source.
 19. The method of claim 13 furthercomprising the step of detecting a presence of the shopper entering inor exiting out the self-checkout terminal with a motion detectorequipped by the self-checkout terminal.
 20. The method of claim 13further comprising the step of issuing an alarm, with an alarm device incommunication with the self-checkout helper device, when the non-scanitem is detected near an exit, wherein the alarm device is located atthe exit of a store employing the self-checkout terminal.